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WHAT IS CLAIMED IS: 



l.\ A position and orientation determination apparatus 
whiolg identifies a parameter indicating a position and 
orientation of capture means for capturing a picture in real 
a space\containing a plurality of feature points whose 
position^ are known in a three-dimensional array, 
comprising! 

position and orientation measurement means for 
measuring the position and orientation of the capture means 
in a method otrrer than using a captured picture; 
;ion means 




detect: 
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s for detecting the plurality of feature 



points and their petitions in a two-dimensional array on 
an image pickup scre^i using the picture in the real space 
captured by said capt\re means; 

prediction means far predicting the positions of the 



:©j: i 



feature points in the two-dimensional array on the image 



pickup screen based on the position and orientation of said 



aid ] 



capture means measured by s^id position and orientation 
measurement means; and 

correction means for correcting the parameter 
indicating the position and oriehtation of said capture 
means based on the positions of thek feature points on the 
image pickup screen of said capture mbans obtained by said 
prediction means, and based on the posi\ions of the feature 
points obtained by said detection means 

wherein said parameter indicating t'fee position and 
orientation of said capture means for capering, the real 
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space is identif iecrfet^said correction means correcting the 
parameter . 




2. The position orientation determination apparatus 
according to ^aim 1, wherein an artificially applied 
marker is t^sed as the plurality of feature points whose 
three-dimensional positions are known. 




10 



15 



20 



3. The position and orientation determination apparatus 
according to cXkim 1, wherein a point originally existing 



in the real space as the plurality of feature points whose 
three-dimensional positions are known, and whose two- 
dimensional positions can be detected on the image pickup 



screen by said detection rn^ans . 

4 . The position and orientatiori^determination apparatus 
according to claim 1, wherein on tnkpicture in the real 
space captured by said capture means,\nother image is 
superimposed and displayed. 



5. The position and 
according to claim 4, 
image of a virtual obj &c 




v ation determination apparatus 
her image is a drawn 



25 6. The position and orientation determination apparatus 
according to claim 1, wherein s^id position and orientation 
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measurement means is a sensor for measuring the position 
and orientation of said capture means, 

7. The position and orientation determination apparatus 
5 according to cJlaim 6, wherein said sensor is a magnetic 

sensor for measuraring the three-dimensional position and 
orientation of said capture means. 

8. The position an\ orientation determination apparatus 
10 according to claim 1 A wherein said correction means 

corrects the parameter \uch that said capture means either 
rotates or translates. 



9. The position and orientation determination apparatus 

r<^Ln said 



15 according to claim 1, where! 



correction means 



corrects the parameter of said capture means by combining 
rotation transform with transition transform. 

10. The position and orientation^determinat ion apparatus 
20 according to claim 9, wherein saicL correction means 

corrects the parameter of said capture means by combining 
rotation transform with translation transform alternately 
and plural times, 



25 11. The position and orientation determination apparatus 
according to claim 9, wherein said correciion means 

\ 

corrects the parameter such that said capture means can 
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rotate, anathen re-predicts the two-dimensional position 
of the feature point on the image pickup screen based on 
the position <af the feature point in the real space and the 
position and orientation of the camera after the correction, 
and said capture means can translate. 
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12. The position and orientation determination apparatus 
according to claim V), wherein said correction means 
corrects the parameter such that said capture means can 
translate, and then re^-predicts the two-dimensional 
position of the featura point on the image pickup screen 
based on the position of mhe feature point in the real space 
and the position and orientation of the camera after the 

~ - ~ -y- — -•■ 

13. The position and orientation determination apparatus 
according to claim 1, whereii^said correction means 
computes a first average value ©n the image pickup screen 
of said capture means using the\position of the feature 
point obtained by said prediction means, and a second 
average value on the image pickup screen of said capture 
means of the feature point detected by^said detection means, 
and corrects the parameter such that th^ first average value 
matches the second average value. 

14. The position and orientation determination apparatus 
according to claim 1, wherein said correction means 



30 



computes a first average weighting value on the image pickup 
screen said capture means using the position of the 
feature {Sfoint obtained by said prediction means, and a 
second avemage weighting value on the image pickup screen 
of said capture means of the feature point detected by said 
detection meanKS, and corrects the parameter such that the 
first average weighting value matches the second average 
weighting value. 



10 15. The position ami orientation determination apparatus 
according to claim 13\ wherein when said parameter of said 

\ 

capture means is processed plural times alternately by 
rotation transform and \ranslation transform, said 
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correction means repeats utae process until an average value 
or a average weighting vaBae of an error between the 
position of the feature poinmcorrected by said prediction 
means and the position of the\feature point on the image 
pickup screen can be considerably small or until the error 
cannot be smaller. 

16. The position and orientation determination apparatus 
according to claim 14, wherein when Sc&id parameter of said 
capture means is processed plural times alternately by 
rotation transform and translation transform, said 

v 

correction means repeats the process until%n average value 
or a average weighting value of an error between the 



position of the feature point corrected by sa\d prediction 

31 



means a&d the position of the feature point on the image 
pickup screen can be considerably small or until the error 
cannot beVsmaller. 



17. The position and orientation determination apparatus 
according to c\aim 13/ wherein when said correction means 
corrects the parameter such that said capture means can 
rotate, the feature point whose position predicted by said 
prediction means i\ associated with the feature point 
10 detected by said dei^ection means, a rotation axis and a 
rotation angle with wh&ch the position of the feature point 
on the image pickup screen of said capture means using the 
position of the feature pjoint obtained by said prediction 
means matches the position iof the feature point on the image 
15 pickup screen of said capture means obtained by said 

detection means are obtainec^for each feature point, and 
said parameter can be correctedby using average values of 

\ 

the rotation axis and the rotation angle obtained for each 
feature point which is dealt wit 
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18. The position and orientation determination apparatus 
according to claim 14, wherein when sakd correction means 
corrects the parameter such that said\apture means can 
rotate, the feature point whose position predicted by said 
prediction means is associated with the %ature point 
detected by said detection means, a rotation axis and a 
rotation angle with which the position of the feature point 
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on the imaged pickup screen of the capture means using the 
position of raie feature point obtained by said prediction 
means matches t*he position of the feature point on the image 
pickup screen qf said capture means obtained by said 
detection means Ire obtained for each feature point which 
is dealt with, an^said parameter can be corrected using 
average weighting values of the rotation axis and the 
rotation angle obtained for each feature point which is 
dealt with. 

19. The position and orientation determination apparatus 



\ 



according to claim 13, whferein when said correction means 

i 

corrects the parameter such that said capture means can 

\ 

translate, the feature poirit whose position predicted by 

sqciated wi1 



15 said prediction means is ass 



_th the feature point 



detected by said detection means, a difference between the 
position of the feature point obtained by said prediction 



means and the position of the feature point obtained by said 
detection means is obtained for each feature point which 
is dealt with, and said parameter^can be corrected using 
average values of the difference obtained for each feature 
point which is dealt with. 




20. The position and orientation determination apparatus 
according to claim 14, wherein when said\correction means 
corrects the parameter such that said capture means can 
translate, the feature point whose position predicted by 
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said prediction means is associated with the feature point 
detected byvsaid detection means, a difference between the 
position of wrie feature point obtained by said prediction 
means and the Position of the feature point obtained by said 
detection meanA is obtained for each feature point which 
is dealt with, aVd said parameter can be corrected using 
average weighting values of the difference obtained for 
each feature points which is dealt with. 



21. A position and orientation determining method which 
identifies a paramete^ indicating a position and 
orientation of capture\means for capturing an picture in 
real space containing a plurality of feature points whose 
positions are known in a ythree-dimensional array, 
comprising : 

a position and orientatibn measuring step of measuring 
the position and orientationv^of the capture means in a 
method other than using a captured picture; 

a detecting step of detecting the plurality of feature 
their positions in a t\ 



points and 



w 



wo-dimensional array on 



an image pickup screen using the picture in the real space 
captured by said capture means; 

a predicting step of predicting^the positions of the 
feature points in the two-dimensional array on the image 
pickup screen based on the position and orientation of said 
capture means measured in said positio\ and orientation 
measuring step; and 
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a correcting step of correcting the parameter 
indicating the position and orientation of said capture 
means based on the positions of the feature points on the 
image pickup screen o^said capture means obtained in said 
predicting step, and baseti on the positions of the feature 
points obtained in said d^^cting step, 

wherein said parameter Radicating the position and 
orientation of said capture meante for capturing the real 
space is identified by correcting\he parameter in said 
correcting step. 




22. The program code /which performs the position and 
orientation determining method, according to claim 21. 



15 5*3. lifle storage medium storing the program code according 
to>£laim lb® 
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